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Abstract 

We study the averages of ratios of characteristic polynomials over circular /3-ensembles, 
where /3 is a positive real number. Using Jack polynomial theory, we obtain three expressions 
for ratio averages. Two of them are given as sums of super-Jack polynomials and another 
one is given by a hyperdeterminant. As applications, we give dualities for ratio averages 
between (3 and 4//3. 

MSC-class: primary 15A52; secondary 05E05, 15A15 



1 Introduction 

Products and ratios of characteristic polynomials averaged over classical groups are closely re- 
lated to number theory. Keating and Snaith [KS1, KS2J calculate moments of characteristic 
polynomials over classical groups by using Selberg's integrals. They conjecture that those mo- 
ments derive important coefficients appeared in mean values of the Riemann zeta function and 
L-functions. This conjecture, called the Keating-Snaith conjecture, and its extensions to product 
and ratio averages in [CFKRS2, CFZ2] are motivations for the study of characteristic polynomial 
averages of random matrices. 

Conrey, Farmer, Keating, Rubinstein, and Snaith CFKRSlJ provide the product of charac- 
teristic polynomials averaged over classical groups. Furthermore, the averages of the ratio are 
calculated in [BGl ICFZH ICFSl IHPZ] . We note that Bump and Gamburd [BG] evaluate those 
averages by applying symmetric function theory. Borodin and Strahov [BSJ evaluate product 
and ratio averages in orthogonal, unitary, and symplectic matrix ensembles in terms of deter- 
minants and Pfafnans. Borodin and Olshanski |BUj consider products of a natural analogue of 
the characteristic polynomial in random partitions. 

In the present paper, we deal with the circular /3-ensemble (C/3E) for a positive real parameter 
(3 > 0. This is a much-studied random ensemble, which generalize well-known orthogonal 
(/? = 1), unitary (/? = 2), and symplectic (/? = 4) ensembles of random unitary matrices. In the 
C/3E, the moments of characteristic polynomials are first calculated in |KSlj by using Selberg's 
integral evaluation. Their results are very recently generalized in [Ml] (see also Proposition 12.11 
in the present paper) by applying Jack polynomial theory. Specifically, the average of products 
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of characteristic polynomials over the C/3E is given by a Jack polynomial with a rectangular- 
shaped Young diagram. Our aim in this paper is to extend this result to the ratio case. To do 
it, we employ super- Jack polynomials studied in |KOQl IO| ISVj . which are Jack polynomials in 
two sets of variables. Remark that Ryckman [Rj studies the distribution of some characteristic 
polynomials in the C/3E. 

We will give three kinds of expressions for the ratio average. Those have different advantages 
each other. 

The first expression (Theorem l4.ip derives a dual relation identity for ratio averages between 
the /3-ensemble and /^'-ensemble, with f3' = 4//3 for general (3 > 0. This duality is implied 
by a simple duality for super-Jack polynomials. A similar relation for Gaussian /3-ensembles 
is recently obtained by Desrosiers [D] , and therefore our duality is seen to be its analogue for 
circular ensembles. 

The second expression (Theorem I4.3D derives an asymptotic duality of the ratio averages 
between (3 and /?' as the number n of variables goes to the infinity. As particular cases of 
this expression, the product average of characteristic polynomials is written as a multivariate 
hypergeometric function based on Jack polynomials, introduced by Yan [Y] . 

Both two expressions explained above are given by a sum of super-Jack polynomials. The 
super- Jack polynomials, first appeared in [KO O]. are defined from the usual Jack symmetric 
functions via a homomorphism on the algebra of symmetric functions. As proved in |M2j . Jack 
polynomials associated with rectangular diagrams and with special parameters are expressed as 
a hyperdeterminant. The hyperdeterminant QBBLt lUTllM2| ) is a simple generalization of the de- 
terminant and is defined for a multi-dimensional array of the form (A(ix,i2, • • • , *fc))i<ii,i2 — ifc<n- 
Combining this fact with the first result of us (Theorem 14. ip . we obtain a hyperdeterminantal 
expression for the ratio average, that is our third expression (Theorem 14. 6|) . 

The present paper is organized as follows. In Section 2, we review circular /3-ensembles and 
the previous result for the product average of characteristic polynomials. In Section 3, Jack 
and super-Jack polynomials are reviewed. Finally, in Section 4, we give our main results, three 
expressions for the average of ratios of characteristic polynomials over circular /3-ensembles. In 
addition, in Section 14.41 we remark a Pfaffian expression for ratio averages over the circular 
orthogonal (/? = 1) and symplectic {(3 = 4) ensemble. 

Throughout this paper, we let 

T = {z G C | \z\ = 1}, D = {z G C | \z\ < 1}, 
the unit circle and unit open disc. Unless otherwise stated, we let (3 to be a positive real number. 

2 Circular /3-ensembles 

Dyson's circular /^-ensemble (C(3E n ) is the probability space T n with the probability density 
proportional to 

Z% Zj 

l<i<j<n 
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for z = {z%, . . . , z n ) G T n . Here dz is the Haar measure on T n such that J* Tn dz = 1, or 



F(z)dz= I** ■■■ r F(e id \...,e id -) dei '" d9r ' 



T n J JO 



(2tt)' 



for any continuous function F on T n . The average of F over the C/3E n is defined by 
(F) - (F(z)) - lT^(z)A(z;2/(3)dz 

The denominator is explicitly given by a quotient of gamma functions ([AARJ §8.7]): 



(2.1) / A(z;2//?)dz 



r(jn+l) 

t« v ' " ' r(f + i) n " 

Consider typical cases G {1,2,4}. In those cases, the C/?E n give eigenvalue distributions 
for random unitary matrices as follows. See also the standard reference [Me] and [F, Chapter 
2]. 

Let S 2 (n) = U (n), the group of all complex unitary matrices of size n. The probability space 
S 2 (n) with the Haar measure ^(dM) is called the circular unitary ensemble (CUE). By Weyl's 
integration formula, we see that the probability density distribution for n eigenvalues z\ , ■ ■ ■ , z n 
of a matrix in S 2 (n) is given by ^ A(z; 2//3)dz with (3 = 2. 

Let S 1 (n) be the space of all symmetric matrices in U(n). The space S' 1 (n) is isomorphic to 
the compact symmetric space U(n)/0(n), where 0(n) is the orthogonal group of degree n. We 
equip to S' 1 (n) = U(n)/0(n) the probability measure /ii(dM) induced from the Haar measure 
on U(n). The probability space 5' 1 (n) with the measure fi±(dM) is called the circular orthogonal 
ensemble (COE). The eigenvalue density distribution for matrices in S' 1 (n) is proportional to 
A(z;2//3)dz with (3=1. 

Let S 4 (n) be the space of all Hermitian matrices in U(n, H), where EI is the (noncommutative) 
field of quaternions and U(n,M) is the group of unitary quaternion matrices. The space S 4 (n) 
is isomorphic to U(2n)/Sp(2n), where Sp(2n) is the symplectic group in U(2n). As the COE, 
the probability measure /^(dM) on S (n) is defined. The probability space S 4 (n) with /^(dM) 
is called the circular symplectic ensemble (CSE). Each matrix in S (n) is diagonalizable with 
respect to unitary quaternion matrices and all n eigenvalues of it belong to T. The density 
distribution is proportional to A(z; 2/P)dz with (3 = 4. 

Let S°(n) be the set of all diagonal unitary matrices. Then 5 (n) is obviously identified with 
T n , and the eigenvalue density of the matrix in S°(n) is uniform. This is regarded as the (3 = 
case in C/JEs. 

For general > 0, Killip and Nenciu |KN| define matrix models whose eigenvalues distributed 
according to A(z; 2/(3). 

Suppose = 1, 2, or 4 again. For a symmetric function F on T n , we let F the function on 
S@(n) given by F(M) = F(z\, . . . ,z n ), where the Z\ are eigenvalue of M G S^(n). Then the 
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average of F over S^(n) equals that of F over the C/3E n : 



(F(z)) z eC(iE n = [ F(M)w(dM) =: < 



F(M) / 




if /? = 


1, 






F(M)] 


^ MeCVE n 


if f3 = 


2, 






F(M)) 


^ AfeCSE„ 


if f3 = 


4. 



Consider the function 

n 

*(z;x) = [JCl + xZj-) 
i=i 

for 2 = (zi,...,z n ) € T n and x G C. If (3 G {1,2,4}, the function ^ is the characteristic 
polynomial 

*(z;x) = det(I + xM) 

for M G SP(n), where z\, . . . ,z n are eigenvalues of M. Here we should notice that det(I + xM) 
for M G 5 4 (n) is a quaternion determinant, see [Mej for detail. 

For all (3 > 0, the average of products of "characteristic polynomials" ^ is calculated in [Ml| 
as follows. Let pjf* be the Jack P-polynomial (see the next section). 

Proposition 2.1 ( |Mlj ). Let (3 be any positive real number. Let x\,X2, ■ ■ ■ ,Xl,xl+i, . . . ,xl+k 
be complex numbers. Assume that Xi, 1 < i < L are nonzero. Then it holds that 



(2.2) / f[ m X- 1 ) f[ *L + k) ) = 0*1*2 • • • XL)-" ■ P^if (X) 

\i=l fc=1 / zeC(3E n 

with a = 2/(3 and x = [x\,X2, ■ ■ ■ ,xl,xl+i, ■ ■ ■ ,%l+k)- Here ~z = (zT, . . . ,z£). 
Example 2.1. For x G C \ {0} and y G C, we have 



with a = 2/(3. Here (a)k = a{a + l)(a + 2) • • • (a + k — 1) is the Pochhammer symbol. 

Consider the limit (3 — > in (|2.2p . Then the left hand side on (|2.2p is the average with respect 



to the uniform measure on T n . The limit of Jack P-polynomial P-[ as a — > is well-defined 
and is given by ( |Macl VI. 10]) 

d(0) 

where A' = (A'^A^,...) is the conjugate partition of A (see the next section) and e& is the 
elementary symmetric polynomial defined in (|3.3|) below. Hence the right hand side of (|2.2|) is 
equal to (x\ ■ ■ ■ XL)~ n eL{x) n . 

Consider the limit (3 — > oo in (|2.2p . This is the so-called low temperature limit, see [Fl 
§3.6.1]. Then, since P^ 00 ** = m\ ( [Mac} VI. 10]), the right hand side in (|2.2jl equals 

(xi ■ ■■x L )' n m {n L ) {x) = (xi ■ ■■x L )~ n e L (x T l,x^, . . .,x n L+K ). 
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Here m\ is the monomial symmetric polynomial denned in (13, ip . 

Our main purpose in this paper is to extend the identity (|2.2p to the ratio of the form 

(23) I ntiV&xr^-itiLiVtexL+k) \ 

But, in some cases, we regard it with letting S = 0. We remark that, in the denominator on the 
average (|2.3p . we deal with the /3/2-power of characteristic polynomials. This is a consequence 
of an application of Jack polynomial theory. In the case of Gaussian ensembles, the same power 
of characteristic polynomials is appeared, see [D, Proposition 2]. See Remark 14.21 below. 



3 Jack and super-Jack functions 
3.1 Jack functions 

Following to Macdonald's book [Mac], we recall Young diagrams and Jack functions. For a 
Young diagram A = (Ai, A2, • • • ), identified with the partition, we write as A' = (A' l5 A2, • • • ) the 
transposed diagram. Equivalently, the number Aj and A^- is the length of the i-th row and of the 
j-th column in the diagram A, respectively. Define 

z x = n kmk ^, 

k>l 

where = m&(A) is the number of rows whose lengths equal to k: = #{i > 1 | Aj = k}. 
We sometimes express A as A = (l m i2 m2 . . . ). We put 

|A| = = ^ mk an< ^ = ^1 = mk ' 

i>l k>l k>l 

These values are the weight and length of A. For two diagrams A, [i, we write A C if Aj < Hi 
for all i. 

Let a be a positive real number and let A = A(a) be the Q(a)-algebra of symmetric functions 
([Mac, 1.2]). Define the scalar product ( , ) a on A by 

{p\,Pn}a = 5\^a iW z x . 

Here the p\ = p\ 1 px 2 • • • are Newton power-sum symmetric functions pk{x\,X2, • • • ) = x\ + x\ + 
■ • • , and form a basis of A. Let m\ be the monomial symmetric function: if £(X) < n, 

(3.1) m A (a?i,...,x n ) = ^2 X T X T ■ ■ ■ x l n 1 

(7l,...,7n) 

summed over all distinct permutations (71, . . . ,7 n ) of A = (Ai, . . . , A n ). For each diagram A, the 
Jack P-function is defined as a unique symmetric function such that 

^ Q) =™a + £<V> u$eQ(a) 

/t<A 
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and 

(Pl Q) ,Pi Q) )a = if \ + 
Here \x < A stands for the dominance order for diagrams: 
def 

H < A |A| = and [i\ + ■ ■ ■ + m < X± + • • • + Aj for any i > 1. 

We do not distinguish the terminology "Jack functions" from "Jack polynomials" . 
Let b[ a) = ((Pf } ,pf ) ) a )- 1 and = b[ a) P^ a) . The value 6^ is given by 

= c A(a)/c' A (a), c A (a) = JJ(aa A (s) + l x (s) + 1), c' A (a) = JJ(aa A (s) + Z A (s) + a), 

seA seA 

where s = € A runs over all squares in A, i.e., 1 < i < £(X) and 1 < j < Aj. Here 

a A (s) = X{ — j and Z A (s) = X'j — i may be called the armdength and legdength of s, respectively. 
Observe that c' x (a) = a' A 'c A /(a _1 ). 

Let A = (k) = {k, 0, 0, . . . ). Then Q^) = where is given by 



^ k x \k 2 \--- 

k\+k2 + ---=k 



9k {xi,x 2 ,...)= h\k~? '' ' '' 2 



fc 2 ' ' ' ki k 2 

JU 1 iV rt 



with {u)k = u{u + 1) ■ • • (u + A; — 1). For convenience, we let g^ = for negative integers k. 
The generating function for g^ is 



(3.2) Y. sf'W *2. •••>* = IR 1 - ^r""- 



fc i>l 



In symmetric function theory, the generating function is regarded as a formal power series but 
in this paper we will suppose that Xi € B for all i > 1 and that Xj = for i large enough. 
Let A = (l fc ) = (1, . . • , 1). Then = m (lfc) = e k , where 

(3.3) e fc (xi,x 2 ,...) = Yl x h x h--' x h 

t<h<h<-<3k 

is the elementary symmetric function. In particular, the Jack P-function of a 1-column diagram 
is independent with a. 
Letting 

i>i 1 1 ;/ ; seA 
with a' x (s) = j — 1 and ^ A (s) = i — 1, we have 

(3.4) [u]^ = (-an-u/a][ a) . 
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For partitions such that l(\),l{p) < n, it holds ( [Macl VI, (10.20) and (10.37)]) 

" x 



(3.5) P\ V- ) = 1 77V A 



(3.6) (P^( Z )Q^)) !" /ttl A', „„, . 



zeC/3E n ' [1 + (n - I) /a] 



A 



with a = 2/13. 

Let a; Q be the automorphism on A defined by 

(3.7) Lu a (p r ) = (-ly^apr, r > 1. 

Then co a (P { x a) ) = Q ( i /a) and Wq (Q? } ) = p{! /q) ([M VI (10.17)]). 

The following identities are known as the Cauchy identity and the dual one for Jack functions 
([Macl VI, (4.13) and (5.4)]): 

(3.8) Yl p x\ x ^, ■ ■ ■ )Q[ a) (yu 2/2, ) = I] (! " ^i)" 1/a > 

A ij>l 

£ if (xi,x 2 , . . . )p£ /a \yi, y 2 , . . . ) = n (1 + Wi)- 

A i,j>l 
We will use the following reduction formula |Mac|, VI (4.17)]: for a partition A of length n, 

(3.9) P^ ^ (x± , . . . , x n ) = x\ • • • x n p( ^ (xi , . . . , Xji) 
where [i = (Ai — 1, . . . , A n — 1). 

3.2 Super-Jack functions 

To calculate the ratio average of characteristic polynomials in the next section, we need Jack 
polynomials in two sets of variables. 

Define the coefficients f^ v {ct) € Q(a) via 

A 

or equivalently, 

4 A » = = (Q[ a \ Pf ] Pl a) ) a . 

The following properties are seen in [Mac, VI. 7 and 10]. 

Lemma 3.1. The numbers fuv(. a ) satisfy the following properties. 

1. f^ u {a) = unless |A| = |/i| + \u\ and A D /x, A D v. 

2. f^ u {l) = c^ u , where c^ u are Littlewood-Richardson coefficients (e.g. ]Mad 1-5]). 
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3- /^(«)=/^(V«)t(£t 



Define skew Jack functions by 

A//i ~~ 2^ J ^^ JX v ' ^a/a« 



pit = E /»^ a) » < = E /»^ a) • 



Then we have Qw^ = "^-^1/^ an d the duality 



^V^ A //J _ ^A'/At' ' ^Wa/aJ ~ A'/fi' ■ 



Let x, y be the set of (possibly infinite many or empty) variables. Define 



(3.10) Q{ a) (x;y) := £ /*,(a)QW (x)P^ (y) = £ Q^Ux)^ (y), 



(3.11) PW foy) :=E^(«)^ Q) W^ /C1) ^) = £*$(*)Q2 /a) (v). 

At,f 1/ 



We call these functions super- Jack functions (polynomials). This terminology is first appeared 
in [O] as far as the author knows. Sergeev and Veselov [SV| proved that these functions are the 
eigenfunctions for a deformed Calgero-Moser-Sutherland operator. 

Remark 3.1. Our definition for the super-Jack function slightly differs from that in [Dj . Specif- 
ically the function P x (x\y;6) in [O, Eq.(2.7)] is given by P x (x\y;9) = P^ 1/e) (x;6y) with 9 > 0, 
where Oy = (0y 1 ,9y 2 , ...). 

Note that Q x 1 \x;y) = P^\x;y) is the Littlewood-Schur symmetric function (or super- 
Schur function) LS\(x;y) = J2 U s x/u( x ) s u'{y) (see \BG\ Section 3] and [Mac! 1-5, Ex.23]). It is 
obvious that 

qM{x;V)=qM(x), Pt\x;<D) =Pt\x), 

Qf(0;y) =Pj? /a) (y), P { x a \$;y) =Q ( ^ /a) (y). 

If a; = (xi,...,x p ) and y = (yi,...,y q ), since Qwj^l, • • • , x p ) = unless < A ■ - < p for 

each i > 1 (see |Macl VI (10.18)]), it follows that Q^\x\, . . . , x p ; y\, . . . , y q ) = unless A p+ i < q. 
A partition A satisfying A p+ i < q is said to be a fat (p, g)-hook. 

Lemma 3.2. The functions P\ and have the following properties. 

1. Q^(x;y)=b[ a) Pi a \x;y). 

2. Q^(x;y)=Piy a \y;x). 
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Proof. We have 

since bffibV = 1. It follows by Claim 3 in Lemma 13. II that 

ofW) = E/^(a)oW(*)J°i 1/0) (v) = E&^v^tI^q^w^^) 

=Jm E 4v (V«)^ a) (*)<# /o) (w) = TO «S /a) (v; *) = (v; *)■ 

□ 

The second identity in Lemma 13.21 is the duality for super-Jack functions. This property 
implies a dual relation for ratio averages of characteristic polynomials in circular /^-ensembles, 
see Cor pilar y 14 . 2 1 b elow . 

The Jack Q-function Q^\x U y) in variables x U y = (x±, yi, X2, 2/2, • • • ) is expressed as 
( jMacl VI.(7.9)] 

Q[ a \ X Uy) = ^Q[ a l( X )Qi«\y). 

V 

Denote by Wa the homomorphism tu a acting on symmetric functions of the y variables. Observe 
that 

(3.12) Q^\x;y) = £Q$(*M(Q< o) (y)) = ^Q^(x U y). 

This fact implies that a super-Jack function is a specialization of the Jack function. In fact, the 
algebra A of symmetric functions is generated by {fl^ | k > 1} and the gf^ are algebraically 
independent over Q(a). Define the homomorphism <j) a on A by 

k 

Mgi a) ) = 9 k a \x-y) := u VgW(x U y) = ^{"W-Kv)- 
Equivalently, we define </> Q by 4>a(Pk) = Pk(x) + (— l) fc_1 apfc(y) for power-sums Then 

(3.13) a (Qi Q) ) = Qi Q) (^y) 

for any partitions A. 

The following is the Cauchy identity for super-Jack functions. 

Lemma 3.3. Let x = (xi),y = (yi),u = (ui),v = (vi) be sequences of variables. Then 

^Pi a Hx;u)QP(y;v) 
x 

= n c 1 - x iyj)~ i/a n o- + x ^ u w) n ^ - ^y*- 
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In particular, 



(3.i4) ^pfV)QfW)= n (i - x^r 1 /* ■ Y[(i+ Xl v 3 ) 

A M>1 



Proof. We apply wju" to the Cauchy identity (recall (|3.8p ) 
^P{ Q) ^U M )Q( Q) (1/U,;) 

A 

= n a - ■ n a - x^-)- 1 ^ . n a - n ^ - ^-r i/a 

i,j>l *J>1 

Then the desired identity follows from (|3.12p . Here we have used 

<*>i n (! - u ^i) -i/Q = e oi a) («)^ a) («) 

=x;if /a) (u)gS /o) («)= n(i-«i«i)" a - 

A i,j>l 



4 Averages of ratios of characteristic polynomials 



□ 



Our purpose is to obtain three kinds of expressions for the ratio average (|2.3p and for its degen- 
erations. 

4.1 First expression and a duality between (3 and 4/ ' (3 

For two diagrams A and //, we define A + \x to be the sum of the sequences: (A + = A, + /Zj. 
Also we define A U ix to be the diagram whose rows are those of A and fi, arranged in descending 
order. Observe that (A + fj)' = A' U //. 

Theorem 4.1. Let 

x = (xi,...,x L ,x L+ i,...,x L+K ), u = (ui, . . . ,u s ), v = (vi,...,vt) 

be sequences of complex numbers. Assume that X{ ^ for 1 < i < L and u s ,Vt € D for 1 < s < S 
and 1 < t < T. Then we have 



nf = i*(*;*rVnf = i*(^L +fc ) 

nf=i*(^;-^)^ 2 -n t =i*(^;-^ /2 



zeC/3E„ 



\n L ) 

[-n + 1 - a]^" ; M: ^ n [-n + 1 - (L + l)a ifl 
with a = 2/(3. 



1 nJ (« L )' [-n-aL]^ /a) p.(l/a) , \nXoi), \ 
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Proof. First we see that 

L K L+K 

Yl *(z; xj 1 ) ■ Yl x L+fc ) = (n • • • x L )- n ■ ( Zl ■ ■ ■ z n )- L ■ Yl x fc ). 
i=l fe=l fc=i 

By Cauchy identities (|3.8I) and ()3.14p . we have 
Since P^Jz) = (zi ■ • ■ z n ) L by (13. 9p . we see that 

/ nf =1 *(s;zrVnf=i*(*;zL+*) \ 



\nf=i *(*; -^) /3/2 • nLi *(*; -^ /2 / zec/3En 

( = 1 A, [I 

By using ()3.9[) and the orthogonality (|3.6fl . we have 



[1 + (n - l)/a]^(L») 

for partitions A and /x such that ^(A) < n and < n. Therefore the desired average is equal 
to 

IK"- E '" /g 5% ^.(■i-wi.-'w- 

1=1 ^)<n [ 1 + (^- 1 )/«]) t +(L«) 

Using equation (|3.4|) and the second claim in Lemma |3, 21 and replacing fi by //, it equals 

L \-n\ {1/a) 

Y\ x ~ n • V (nL)UAt {1/a) (x-v)O ia) (u) 

i=i ^i<n [-n -h i - aj (nL)u ^ 

Observing 



we obtain the claim. □ 
As a special case of Theorem l4.lt we have the following: Letting u = 0, since 
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we have 

(4.1) 

(4.2) 



nr =1 *(*; -vtf' 2 



zGC/3E n 



--(xf-x L )- n -pWf(x;v) 
--{xi ■ ■■x L )~ n ■ Q^(v;x). 



Moreover, if we let v = 0, we recover Proposition 12.11 

The equation Q^\v;x) = Py^ a \x;v) derives the following duality relation for ratio av- 
erages between the /3-ensemble and another /^'-ensemble with (3' = A/f3. A similar result for 
Gaussian /3-ensembles is seen in [D] , 

Corollary 4.2. Let f3 be a positive real number and set (3' = 4//3. Put 

x = (xi, . . . ,x m ,x m+ i, . . . ,x m+K ), v = (vi,. . . ,V n ,V n+ l, . . . ,V n+T ). 
Assume Xi, Vj E ID for all Then we have 



--(yi ■ ■■v n y 



nr=7 -v t y/ 2 
, n^i^;^ 1 )nLi^i" B+ t) \ 



zeC/3E n 



Here^(w;x) = Hf =1 (l + xWj) f or w = (wi,...,w m ) G T m . 



Proof. By ()4.ip , the left hand side on the equation in the statement is equal to b^m^P^m? (x; v) = 
Q{wm) ( x ' v )- ^ n * ne other hand, the right hand side is equal to QLm) \ x \ v ) by (14. 21) . □ 

Roughly speaking, there exists a duality: 







/4/A 


n 




m 


m 


< > 


n 


X 




V 






V * / 



4.2 Second expression and its asymptotic behavior as n — > oo. 

We obtain the second expression for the ratio average. 

Theorem 4.3. Lei 

a; = (xi,...,x L ), y = (yi,...,yK), u = (m, . . . ,u s ), v = (v 1 , 



,vt) 
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be sequences of complex numbers. Assume u s ,vt € B for all s,t. Then 

I nti*(s;*j)-nf=i*(*;ifc) \ 



(4.3) 



r l(l/«) 



= E r 1 7 /a) ^( g ;t»)q^(y;i>) 

A:Ai<n l~n + 1 - 

with a = 2/(5. 

Proof. By the generalized Cauchy identity (|3.14j) . 

/ nf = i*(*;^-nf = i *(*;*/*) \ 

\ nf=i m -^ /2 ■ nL -^ /2 / zec/3En 

=Eoi a) («; a ')% a) («;»)W a) (z)^ 0) (*)> prflF • 

From orthogonality (|3.6p it equals 

(4-5) E . J w/a £ l(tt) Ql tt) («;^ tt) («;y). 

Using equation (|3.4p and the second claim in Lemma 13.21 we obtain our statement. □ 
The multivariate hypergeometric functions in two sets of variables are defined by ([Y]) 
pj~ ^ (oi , . . . , cip, h\ 1 . . . , bqi x\ j . . . , x n , y\ , . . . , y n ) 



nu<4 a) °wp!?\x 1 ,...,x n )pi a Hvu...,v n ) 

UUN? ^(a)P^(l«) 



A 

nr=ik]i Q) ^ Q) (xi,...,x n )Qi a) ( yi ,..., yn ) 



^ ^ I7,.l 1,,! f„ /,- 1 l f " i 



a Utiinr [n/<*]\ 

The function o«^b (~ i ~~ ! £i> • • • > ^n! yi> ■ ■ ■ 5 2/n) is called multivariate Bessel function in [D] and 
plays important roles for Gaussian /3-ensembles, see [BF, D]. By Theorem 14. 3} we have the 
following hypergeometric expression for the product average: 

In n \ 

I Yl y(z; Xj ) ■ Yl yj ) \ = 2 ^i (/3/2) (-n, 2n/# -n + 1 - 2//3; Xl , . . . ,x n ; y x , . . . , y n ) 

for all complex numbers x%, . . . ,x n ,yi, . . . ,y n . Similarly, it follows from (14. 5p that 

In n \ 

(n*(^-%)^ /2 -n^-^ /2 ) 

=2^"i (2//3) (n/?/2, n/3/2; |(n - 1) + 1; « a , . . . . . . , v n ) 
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for any u\, . . . ,u n ,vi, . . . ,v n £ D. We note that another hyper geometric expression for moments 
of characteristic polynomials is given in [FK] and |Mll (4.8)]. 

As a corollary of Theorem 14.31 we have the following asymptotic duality for ratio averages 
as in the limit n — > oo. 

Corollary 4.4. Let 

x = (xi,...,x L ), y = (yi,...,yK), u=(u 1 ,...,u s ), v = (vx,...,vr) 
be sequences of complex numbers in D. Let (3 be a positive real number and set (3' = 4//3. Then 



lim 



nf = itt(*;ai)-nLi*(*;*/iO 
™ \nf=i -u s )^ • nr =1 -vtY' 2 , 

- x Wk y 2 ^ ■ + xivt) ■ ]J(1 + u s y k ) ■ \\(1 - u s v t ) 

l,t s,k 

Us=i9(z;u s )-Uj =1 9(z;v t ) 



l,k 
lim 



z€C/3E„ 



s.t 



-0/2 



nf=i*(^;-^' /2 -nf=i*(^ 



-Vk 



)/9'/2 



zeC/3'E„ 



Proof. Let a = 2/(3. Observe that, as n — > oo, 



-n 



(l/a) 



[-n + 1 - a]^ 1/a) 



for A fixed, and therefore, by Theorem 14.31 two ratio averages in the corollary converge to sums 

£ Pi 1M (x; u)QW (y; „) and £ («; a:)^ (v; y) 

A A 

with a' = 2/(3' respectively but these are equal each other. The product expression in our 
statement is obtained from Lemma 13,31 □ 



Roughly speaking, there exists a duality: 



f/3\ 






X 




u 


y 


i > 


V 


u 




X 


W 




\y J 



m n — > oo. 



Remark 4.1. The product expression in Corollary 14.41 follows directly from the following strong 
Szego-type formula, which is algebraically proved in [Mil Theorem 3.4 and (4.10)]: Let <p(z) = 

ex P(Sfcez c(k)z k ) be a function on T and assume ^fcez l c (^)l < 00 an d J2k& l^ll c (^)| 2 < °°- 
Then 



lim e~ nc ^ ( TT 



exp a kc(k)c(—k) 



\j=i 



z€C/3E n 



fe=l 
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Indeed, if we take 

<P(z) = + Xi/z) 11(1 + Vkz) H(l - u s /z)-y a - v t z)-V«, 

Iks t 

then a simple calculation gives c(0) = and 

c(k) = {(-l)V(y) - a- l p k (v)}/k, c(-fc) = {(-l)*p fc (a:) - a- l Pk (u)}/k for fc > 0, 
and therefore we obtain Corollary 14.41 again. 

4.3 Third expression involving hyperdeterminants 

For a multi-dimensional array A = (A(i\,i<2, . . . , i2p))i<i 1 ,i 2 ,...,i2 P <N, the hyperdeterminant (see 
e.g. \LT\ IM2] ) of A is defined by the multi-alternating sum 

det [2pl (^) = sgn(cri)sgn(<7 2 ) • • • sgn(cr 2p ) 

0"l,0"2v-!°"2p£SjV 

N 

X n^(0"l(>') 5 0"2(<), • • -,(T2p(i)). 

i=l 

If p = 1, this definition is reduced to the determinant of an N by iV matrix A = (A(i,j))i<i j<N- 
In |M2j (see also jBBLj ). the following hyperdeterminantal expression for rectangular Jack 
functions is obtained. 

Proposition 4.5. For positive integers p, a, b, 
(i/p) _ b\(p\) b [2p] (1/p) 

( ab ) ~~ (pb)! ^a+ii+i 2 +-+ip-Jp+i i2 P A<»i,.»,*2p<6- 

Therefore Q^ b f(x; y) = ^^det[ 2p ](^ 1 + / f i ) +i2+ ... + . p _. p+i _..._ i2p (a;; 2/))i<i lr ..,i 2j ,<b /or any sequences 
x,y of variables. 

From corollaries (|4.1|) and (|4.2|) of Theorem 14. 1} we now derive the third expression for the 
ratio average. We must assume here that either parameter (3 or its dual one f3' = 4/(3 is an even 
integer. 

Theorem 4.6. Let 

x = (xt, . . .,x L ,x L+ i, . . .,x l +k), v = (vi, ...,v T ) 

be sequences of complex numbers. Assume that x% ^ for 1 < i < L and vt € B for 1 < t < T. 
Suppose that (3 is an even positive integer: 



= 2p. 
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Then we have 



( 4 -6) = ! ^(*i-"*L)^detM(^ 

We notice that the entries g^^ p \v;x) of the hyperdeterminant on (|4.6|) are ratio averages 
over T = U(l) = C/JEj with respect to the uniform probability measure: 

<m( s / n[ = i^^r 1 )-nLr + i^(^;^) \ 

g). /P) (v 1 ,...,v T ;x 1 ,...,x R ) =x 1 ---x r { — T - ) 



n[=i(i+^ _1 )-ntr+i(i+^ 



I ± At — ± v L / X ±rc — 7 -T± \ 'J 

=xi---x r / ^ 

A nL(i-^) p 

for R> r. 

Theorem 4.7. Let x and v be as in Theorem \4-6\ Suppose that 

= 2/p 

with positive integer p (i.e. 4/(3 is the even integer 2p). Then we have 

/ nf = i*(^rVnti*(*;^ +fc ) \ 
\ nL*(*;-^ 2 / zecpEn 

Remark 4.2. Define a deformed super-Jack function by 

■V 



^ ) (^f)=E p £( :c K(^ ) (3')). 



where lo\ is the homomorphism u) a with a = 1, acting the y variables. Compare this with (|3.12|) . 
Then, for example, one may obtain the following ratio average evaluation similar to (|4. 1 j) : 



II'/ , v|/(z;-^) , ^ ( 



(4.7) ( 111=1 ; ,;,: U= !.?^' XL+fe; ) =(x 1 ...x L )-.^(.;.). 



In particular, if /3 = 2/p with a positive integer p, we have 



with 

i> xp := ( vi,...,vi , v 2 ,...,V2; ■ ■ ■ , vt, ■ ■■,vt) - 

V V V 

On the denominator of the ratio of the left hand side in (|4.7I) . the power of characteristic 
polynomials is 1 instead of (3/2. However, if one considers such a ratio average, our dualities 
given above are lost. 
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4.4 Pfaffian expressions for ratio averages over the COE and CSE 

Consider the COE {fi = 1) and CSE ((3 = 4). Let *(M; x) = det(I + xM) be the characteristic 
polynomial of a unitary matrix M in S 1 (n) or S (n). Theorem 14.61 and Theorem 14.71 give 
hyperdeterminantal expressions for the ratio average in the COE and CSE. On the other hand, 
in those cases, the ratio averages can be expressed by a Pfafhan as follows. We need a Pfaffian 
expression for Jack functions at a = 1/2 with rectangular diagrams. Such an expression is seen 
in [AKVl IM2] and we rewrite its proof in the appendix below. 

Proposition 4.8. Let x and v be as in Theorem \4-6[ Then 

I Till *(M; xj 1 ) ■ n£=i x L+k ) \ 

\ Ul^(M;-v t )^ / MeCOEn 

L-1 

= H(n + 2j + l)- 1 • (xi • • ■ xz)-" • Pf ((j - i^Hl+^ix; «))i< lJ < 2 L 

j=0 

/ nil *(M; xT 1 ) ■ Uk=i *(M; x L+k ) \ 

\ nL*(M;-^ / MecSBn 

= (2n- 1)!! ' (Xl " ' ' Pf((j ~ WL+t+i-i-jto x ))i<i,j<m- 

Proof. Consider the COE case. By (|4.ip our ratio average equals (x\ ■ ■ ■ XL)~ n V^J^ (x; v). Since 



6^ / L 2 ) ) (2L-l)!! = nV + 2j + l), 

j=0 



the desired Pfaffian expression follows from (|3.13p and Proposition IA.ll below with A = (n L ). 
The proof of the CSE case is similar. □ 
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Appendix 

A Pfaffians and rectangular Jack functions at a = 1/2 

For any 2n x 2n antisymmetric matrix B = (6«)i<i j<2n> the Pfaffian of B is defined by 

1 " 
Pf(S)= 2^! 2 sg^IIkCM-iM*)- 

' 0-G©2n »=1 
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More generally, given an upper triangular array (&ij)l<i<j<2nj we denote by Pf(frjj)i<j<j<2n the 
Pfaffian of the antisymmetric matrix B = (6ij)i<j j<2n whose diagonal and lower triangular 
entries are defined by bn = and by bji = —bij for j > i. 

Proposition I A. II below gives the Pfaffian expression for the Jack function of a rectangular 
diagram with parameter a = 1/2. This Pfaffian expression is reminiscent of the Jacobi-Trudi 
identity for Schur functions: s\ = det(/iA i -i+j)i<ij<n ) where h k = g k are complete symmetric 
functions and n is any integer such that n > £(X). 

The following proposition for n = £(X) is proved in |AKV^ IM2] . Note that in [M2j we give 
a hyperpfaffian expression for rectangular Jack functions with parameter a = l/(2k) with any 
positive integer k. We abbreviate one-row Jack Q-functions 

Proposition A.l. Let X be a rectangular Young diagram and let n > £(X). Then 

|Pf(C? _ i)g~ 1j +2n+l-i-j)l<i<j<2n- 



with a = 1/2 as g k . 



(2n- 1)!! 
Here the jj are given by 

(7l)72,---,7n,7n+l,--- 

Also we have 



l2n) 



(A n , A n _ 



, Ai, Ai, . . . , A n ). 



p(2) 
A' 



1 



Pf((j ~~ i)e yj +2n+l-i-j)l<i<j<2n 



(2n-l)!! 

by the automorphism u)\/2 defined in (13. 7\\ . 

Example A.l. Let A = (Ai,A2,A3) be a rectangular diagram of length < 3, i.e, A = (L,0,0), 
(L, L, 0) or (L, L, L) for a positive integer L. Then 



— -Pf 
15 



f 





5A 2 +4 


2c/Ai+3 


3^Ai+2 


45A2+1 


%A 3 \ 




~5A 2 +4 





5Ai+2 


2#Ai+l 


35A 2 


4#a 3 -i 




-2gAi+3 


~9Xi+2 





5Ai 


25a 2 -i 


35a 3 -2 




-35Aj+2 


-2ffAi+i 


-9M 





5A 2 -2 


25A 3 -3 




-45A 2 +i 


-3#A 2 


-2ffA 2 -l 


-5A 2 -2 





5A 3 -4 


K 


-5/?a 3 


-%A 3 -1 


-35A3-2 


-25A3-3 


-5a 3 -4 


o J 



Proof of Proposition \A.ll First we prove the case where n = i(X): 



(A.l) 



1 



(2n - 1): 



r Pf ((j - *)S'a+2n+l-i-i( £C ))l<iJ<2n- 



Here we may suppose that complex variables X{ are in ID and that Xi is zero if i is large enough. 
Recall the de Bruijn formula [De]: For a family {(f)j,ijjj \ 1 < j < 2n} of functions on a measure 
space (X, fi(du)), 



(A.2) 
(A.3) 



1 



=Pf 



— / det(4>j(u k ) | 4>j(u k ))i<j<2n,i<k<nKdui) ■ ■ ■ n(du n ) 



X 



l<j,k<2n 
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Here det(ajfc | bjk)i<j<2n,x<k<n stands for the determinant of the matrix whose j-th row is 
(oj-j feji a j2 b j2 ... a jn b jn ). Apply this formula to functions 

i>l 

on T with the normalized Haar measure dz. Then, since (e.g. [Me, pp.216]) 
det(zi~ n ~ 1/2 | (j - n - l/2)4~ n ~ 1//2 )i<j<2n,i<fc<n = J j | 

l<i<j'<n 

the integral in (|A.2|) is 



Z% Zj I , 



p It 

/ (:,-,:„)-"[] |T(1 - ,-,:/) 2 - ]"J |^-^| 4 dz 

r>ii=i 

Cn ( {zi ■■■z n )- a Y[^(z;-Xi) 
\ i>i 



z€C4E„ 



Here the constant c n defined by c n = J T „ Y\ i<C j \z{ — Zj\ 4 dz, is explicitly given as c n = (2n)!/2 r 
by ()2.ip . It follows by the reduction formula (|3.9p and the Cauchy identity (|3.8p that 



' zGC4E„ A 



zGC4E n 



and, by the orthogonality (|3.6|) . it equals 



P^c-x _ ,(l/2) p (l/2) r s _ n (i/2) M 



Finally, the equation (|AT2|) is (2n - 1)!!Q[^ ) (x). On the other hand, (|X3|) equals 



[l + 2(n-l)]£ n) 

mm 

(a™) 

Pf | - i) z -*-2n-l+i+j Y[(l - x k z)- 2 dz J = Pf ((j - i)ya+2n+l-i-i(^)) 



l<«J<2n 

l<j,j<2n 



by (|3.2|) and we have proven (jA.ip . 

Next we prove the case n > £(X). To do it, it is enough to prove that, if \ n = 0, 

(A.4) Pf((j - i)5 7i +2n+l-i-i)l<i<i<2n = (2n - l)Pf((j - i)%+2(n-l)+l-i-i)l<i<j<2(n-l)! 

where jj are given by (71, ... , j2n-2) = (A„_i, . . . , A 2 , Ai, Ai, . . . , A n _i). But, expandin g the 
pfaffian on the left hand side of (|A.4j) with respect to the last column, we can obtain (|A.4p 
immediately. □ 
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It is a natural question whether the Jack function Q^ 2 ^ for any A has a Pfaffian expression. 
Consider partitions A = (Ai, A2) of length < 2. Then, since (see e.g. [J JJ ) 



one can write as 



,Ai -A 2 + 2 
'Ai - A 2 + 3 



9x 1 +i9x 2 -i + 



Ai - A 2 + 1 
Ai - A 2 + 3 



ffAi+25A 2 -2, 



Q 



1 



(1/2) = 

(Ai,A 2 ) Al _ A2 + 3 



Pf 



/0 ffAi+2 2g Al +i (Ai-A 2 + 3)5a 2 \ 
ffAi (Ai - A 2 + 2)5- A2 _i 
(Ai - A 2 + 1)<7a 2 -2 




Here we abbreviate lower entries of the Pfaffian. We could not find such an expression for general 
partitions A of length > 2. 
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